The growing number of statistical topic models led to the need to better evaluate their output. Traditional evaluation means estimate the model’s fitness to unseen data. It has recently been proven than the output of human judgment can greatly differ from these measures. Thus the need for methods that better emulate human judgment is stringent. In this paper we present a system that computes the usefulness of individual topics from a given model on the basis of information drawn from a given ontology, in this case WordNet. The notion of utility is regarded as the ability to attribute a concept to each topic and separate words related to the topic from the unrelated ones based on that concept. In multiple experiments we prove the correlation between the automatic evaluation method and the answers received from human evaluators, for various corpora and difficulty levels. By changing the evaluation focus from a statistical one to a conceptual one we were able to detect which topics are conceptually meaningful and rank them accordingly.

AI Magazine Volume 10 Number 4 (1989) ( AAAI) generated some controversy. Relative to the discussion of the role of strong syllables in lexical segmentation, Gerry Altmann of CSTR reviewed some of the evidence based on computational studies of large The 1988 Workshop on Cognitive bone. Evidence from human studies computerized lexicons (20,000 Models of Speech Processing was suggested that the spurious word is words). This evidence suggested that held at Park Hotel Fiorelle, Sperlonga, activated, even though in principle it a stressed syllable conveys more Italy, on 16-20 May 1988. Twentyfive would be possible to prevent this activation information about the identity of the participants gathered in this by only accessing the lexicon at word in which it occurs than an small coastal village, where the the offset of some previously found unstressed syllable.